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QUANTITATIVE PREDICTION METHOD 

The present invention concerns methods and systems for analysis of drug resistance in 
HIV-1. More specifically, the invention provides methods for predicting drug 
resistance by correlating genotypic information with phenotypic profiles. The methods 
5 allow the identification of primary and secondary resistance-associated mutations for 

new and existing drugs and for calculating the contribution of mutations and 
combinations of mutations to resistance and hyper-susceptibility. The invention allows 
the design, optimization and assessment of the efficiency of a therapeutic regimen 
based upon the genotype of the disease affecting a patient. 

10 This application claims priority benefit of EP patent application nr. 03 101 687.6, and of 
U.S. Provisional Application No. 60/478,780 filed on June 16, 2003, the contents of 
which are expressly incorporated by reference herein. All other publications, patents 
and patent applications cited herein are incorporated in flill by reference. 

15 BACKGROUND 

Techniques to determine the resistance of HIV-1 to a therapeutic agent are becoming 
increasingly important. Many patients experience treatment feilure or reduced efficacy 
over time. This is generally due to the virus mutating and/or developing a resistance to 
the treatment. As used herein, "HIV" is the human immunodeficiency virus, which is a 
20 retrovirus. 

The various different anti-HTV-1 agents that have been developed over the years were 
initially administered to patients alone, as monotherapy. Though a temporary antiviral 
effect was observed, all the compounds lost their effectiveness over time. Research has 
now demonstrated that one of the main reasons behind treatment failure for all the 

25 antiviral drugs is the development of resistance of the virus to the drug (see, for 

example, Larder et al., 1989, Science, 246, 1 155-8). This is largely due to the ability of 
HTV continuously to generate a number of genetic variants in a replicating viral 
population. These genetic changes generally alter the configuration of the HTV reverse 
transcriptase (RT) and protease (PR) molecules in such a way that they are no longer 

30 susceptible to inhibition by compounds developed to target them. If antiretroviral 

therapy is ongoing and if viral replication is not completely suppressed, the selection of 
genetic variants is inevitable and the viral population becomes resistant to the drug. 

Since then, dual combination therapy, using drugs that target both HTV reverse 
transcriptase (RT) and protease (PR) molecules, has provided increased control of viral 
35 replication, and thus provided extended clinical benefit to patients. In recent years, 
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however, it has become clear that even patients being treated with triple therapy 
including a protease inhibitor often eventually experience treatment failure. 

Since patients in the developed world are generally prescribed cocktails of therapeutic 
drugs, not all EHV-1 infections originate with a wild type but with drug sensitive 
5 strains, from which drug resistance inevitably emerges. As such, with the increase in 

prevalence of drug resistant strains, there comes an increase in infections that actually 
begin with drug resistant strains. Infections with pre-existing drug resistance 
immediately reduce the drug options for drug treatment and en^hasize the importance 
of drug resistance information to optimize initial therapy for these patients. 

10 Moreover, as the number of available antiretroviral agents has increased, so has the 

number of possible drug combinations and combination therapies. It is therefore very 
difficult, if not impossible, for the physician to establish the optimal combination for an 
individual. Although there are many drugs available for use in combination therapy, 
the choices can quickly be exhausted and the patient can rapidly experience clinical 

15 progression or deterioration if the wrong treatment decisions are made. The key to 

tailored, individualized therapy lies in the effective profiling of the individual patient's 
virus population in terms of sensitivity or resistance to the available drugs. This 
requires the advent of truly individualized therapy. 

There axe certain solutions to this problem currently in use. 

20 Phenotyping directly measures the actual sensitivity of a patient's pathogen or 

malignant cell to particular therapeutic agents. However, this can be slow, labor- 
intensive and thus expensive. 

A second approach to measuring resistance involves genotyping tests that detect 
specific genetic changes (mutations) in the viral genome which lead to amino acid 

25 changes in at least one of the viral proteins, known or suspected to be associated with 

resistance. Although genotyping tests can be performed more rapidly, a problem with 
genotyping is that there are now over 100 individual mutations with evidence of an 
effect on susceptibility to HIV-1 drugs and new ones are constantly being discovered, 
in parallel with the development of new drugs and treatment strategies. The 

30 relationship between these point mutations, deletions and insertions and the actual 
susceptibility of the virus to drug therapy is extremely complex and interactive. An 
example of this complexity is the Ml 84V mutation that confers resistance to 3TC but 
reverses AZT resistance. The 333D/E mutation, however, reverses this effect and can 
lead to dual AZT/3TC resistance. 

35 Sophisticated interpretation is therefore required to predict what the net effect of these 
mutations might be on the susceptibility of the virus population to the various 
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therapeutic agents. Custom algorithms such as rules-based computer algorithms have 
provided some assistance, for example, see International patent application 
WO01 119 540. An overview of this type of technique is presented in Figure 1 . 

Beerenwinkel et al, PNAS (Jun 2002), 99(12), pp 8271-8276; Schmidt et al., AIDS 
5 (Aug 2000), 14(12), pp 1731-1738; and Sevin et al., Journal of Infectious Diseases, (Jul 

2000), 182(1), pp 59-67; disclose methods for quantitating the individual contribution 
of a mutation or combination of mutations to the drug resistance phenotype exhibited 
by HIV based on different algorithms such as, respectively, decision trees, a rule-based 
approach and statistical analyses such as cluster analysis, recursive partitioning, linear 
10 discriminant analysis. In Schmidt et al., AIDS Reviews, 4(3), pp 148-156, further 
methods are reviewed. 

Meisel et al., Therapeutic Drug Monitoring (Feb 2001), 23(1), pp 9-14; and Meisel et 
al., Pharmacogenetics (1997), 7(3), pp 241-246; disclose a method for predicting the 
metabolic activity phenotype from the mutation pattern of the NAT-2 gene by multiple 

1 5 linear regression analysis. The linear regression model describes a quantity Rs, the 

metabolic ratio built up by an error term (first term) and a sum of products built up 
from a mutation factor multiplied by a mutation-dependent resistance coefficient. 
However, given the nature of the NAT-2 genotypic patterns, the above methods do not 
consider the relationship between point mutations within a genotypic pattern. In 

20 particular, the quantitative prediction methods proposed are merely an addition of 
independent variables where effects such as antagonism or synergy between point 
mutations, insertions or deletions are not taken into account. 

There remains a continuing need for the quantitative prediction of HIV drug 
susceptibility from viral genotype. In particular, there is a need for quantitative 

25 prediction methodologies like linear regression modelling which can grasp the 

complexity of the HTV-1 genotypic-to-phenotypic dynamics, i.e. combinatorial effects 
such as antagonism and synergism. Furthermore, because the majority of HIV patients 
have now been exposed to drug cocktails, it is thought that the disease-causing 
retroviruses tend to spontaneously generate mutations that have often co-evolved. This 

30 makes the analysis of which mutations are responsible for resistance to which drugs 
almost impossible using currently available techniques. It also means that mutations 
that contribute to resistance are being overlooked using the currently available analysis 
techniques. 

It is therefore an aim of the present invention to provide methods for improving the 
35 interpretation of genotypic results. 
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It is a further aim of the invention to provide methods for determining (or predicting) a 
phenotype based on a genotype. 

It is also a further aim of the invention to provide methods for predicting the resistance 
of an HIV variant of a particular genotype to a therapy or a therapeutic agent. 

5 It is also an aim of the invention to predict resistance of a patient to therapy. 

It is also an aim of the invention to provide methods to assess the effectiveness or 
efficiency of a therapy or to optimize a patient's therapy. 

It is also an aim of the invention to identify novel HTV-1 mutations that are associated 
with resistance to particular drug therapies or combination therapies. 

10 

SUMMARY OF THE INVENTION 

A solution to these problems involves new methods for measuring drug resistance by 
correlating genotypic information with phenotypic drug resistance profiles measured 
experimentally. 

1 5 According to a first aspect of the invention, there is provided a method for quantitating 
the individual contribution of a mutation or combination of mutations to the drug 
resistance phenotype exhibited by HIV, said method comprising the steps of: 

a) performing a linear regression analysis using data from a dataset of matching 
genotypes and phenotypes, whereby the log fold resistance, pFR, is modelled as the 
20 sum of all the individual resistance contributions for each of the mutations or 

combinations of mutations that occur in HIV according to the following equation; 

pFR = $ A M A + $ B M B +'~+$z M Z +£ 

wherein each individual resistance contribution is calculated by multiplying a mutation 
factor, Ma , Mb , Mz, for each mutation or combination of mutations by a 
25 resistance coefficient Pa. &B> »•* Pz\ 

wherein the mutation factor assigned to each mutation or combination of mutations 
reflects the degree to which that mutation or combination of mutations is present in the 
HIV strain and, if present, to which degree the mutation is present in a mixture; 

wherein each resistance coefficient reflects the contribution of the mutation or 
30 combination of mutations to the fold resistance exhibited by the strain; 

and wherein the error term e, represents the difference between the modelled prediction 
and the experimentally determined measurement. 

This method involves a data driven technique for quantitative drug susceptibility 
prediction. This method uses a multiple linear regression model to estimate coefficient 
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values that accurately reflect the contribution made by a particular HTV mutation or 
combination of mutations to resistance to a particular drug. Repeating the method for 
each candidate therapeutic drug allows the compilation of a global picture of drug 
resistance exhibited by a particular HIV strain. 
5 This method has allowed the identification of mutations hitherto unrecognized as 

having an effect on drug resistance in HTV. The method also allows the identification 
of primary (single mutations) and secondary (the co-occurrence of two mutations) or 
higher order terms resistance-associated mutations for new and existing drugs, which 
embrace the antagonistic and synergistic phenomena. Accordingly, a further aspect of 
10 the invention provides a method of identifying a mutation that affects the degree of 

drug resistance exhibited by an HIV strain using a method according to the first aspect 1 
of the invention. 

The method of the first aspect of the invention is also advantageous over current 
methods since it allows the quantitative, purely data-driven, objectivejissessment of the 

1 5 contribution of mutations and combinations of mutations to drug resistance. The 
method also allows the de-convolution of the individual contribution made by 
particular mutations to the drug resistance phenotype. Unlike existing methods, the 
method is able to correct for correlating mutations that on the face of it appear to affect 
drug resistance, but which in fact only correlate in their occurrence with resistance 

20 causing mutations and are themselves phenotypically silent. 

The method has allowed the design of an automated computational technique for the 
prediction of the drug resistance profile possessed by a particular HIV strain infecting a 
patient The methods thus allow the determination of a patient phenotype without 
having to perform any phenotypic testing whatsoever. This has clear ramifications for 
25 the bespoke design, optimisation and assessment of strategies for individual patient 

therapy based upon the genotype of the infecting agent. 

The invention also provides diagnostic kits for performing each of the methods of the 
invention described herein. 

30 DESCRIPTION 

In any population of HTV variants, there is a wide distribution of drug resistance 
phenotypes for any particular drug, ranging from hyper-susceptibility to strong 
resistance (see Figure 2). The expression "drug resistance phenotype" means the 
resistance of an HIV virus to a tested therapy, therapeutic agent or drug. The term 
35 "resistance" as used herein, pertains to the capacity of resistance, sensitivity, 

susceptibility, hyper-susceptibility or effectiveness of a therapy against a disease. The 
term "therapy" includes but is not limited to a drug, pharmaceutical, or any other 
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compound or combination of compounds that can be used in therapy or therapeutic 
treatment of HIV. This distribution of drug resistance reflects the large number of 
different genotypes that are present in the population. Some variants may only have 
one mutation that is correlated with drug resistance, whilst others will have several or 
5 numerous such mutations, each of which may impart its own contribution to the drug 
resistance phenotype. 

Adding an additional level of complication are the phenomena of antagonism, synergy 
and enhancement, where certain mutations may add to or detract from the effect of 
other mutations in a manner not predictable from studying the effects of the individual 

10 mutations alone. Highly correlated mutations are also problematic. These are 
mutations that almost always co-occur in a strain, but only one of the mutations 
actually has an effect on drug resistance. For example, when one of these 2 mutations 
has an effect on resistance and the other mutation does not (this mutation might for 
example be highly correlated with the resistance mutation because it affects the 

15 replication rate of the virus), the effect can erroneously be assigned to either one of the 
mutations. 

Examples of mutations known or suspected to influence the sensitivity of HIV to drug 
therapy may be found on the internet at http://hiv-web.lanl.gov; 
http://hivdb.stanford.edu/hiv/; or http://www.viral-resistance.com. 

20 In HIV, two sections of the genome are generally studied: Protease (PR) and Reverse 
Transcriptase (RT). The methods of the present invention can equally be applied to 
other sections of the HTV genome such as Integrase (IN). A mutation is presented as a 
number referring to the position in the protein, followed by the amino acid(s) on that 
position, if it differs from the amino acid in the HXB2 HTV reference. In the terms 

25 included above, the mutations are represented as "A", "B", . . ."Z". 

Mixtures reflect the diversity of the HIV population in a sample. It means that on that 
position two subsets of the population have a different amino acid. Mixtures are 
denoted by separating amino acids with the V character: 65K/R (mixture of 6 K' and 
'R' at position 65). 

30 When more than two amino acids are found on a certain position in subsets of the 
population, the dummy amino acid 'X' is used. 

Insertions are denoted by adding the insert position behind a dot: 69.2S (an insert of 6 S' 
at insert position 2). Deletions are denoted by a minus sign: 69-. 

Examples of mutations present in the RT domain of HIV conferring resistance to a 
35 reverse transcriptase inhibitor include 69C, 69V, 69T, 75 A, 101 1, 103T, 103N, 184T, 
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188H, 190E, 219N, 219Q, 221 Y, 2211, and 233V. Additional examples of mutations 
present in the protease (PR) domain of HTV conferring resistance to a reverse 
transcriptase inhibitor include 24M, 48A, and 53L. A mutation may affect resistance 
alone or in combination with other mutations. 

5 For the purposes of the invention, the mutations identified should be associated with 

resistance or susceptibility to drug therapy, for example an antiretroviral drug. The 
degree to which a particular mutation pattern may affect resistance may be determined 
by one of skill in the art, for example, using the phenotypic resistance monitoring assay 
such as, the ANTIVTROGEAM® (Virco, Belgium) (see WO97/27480). In this 

10 methodology, resistance is determined with respect to a laboratory reference strain 

HIVLAI/IIIB. The difference in IC 5 o (the concentration of drug required to reduce the 
virus 1 growth in cell culture by 50%) between the patient sample and the reference viral 
strain is determined as a quotient This fold change in IC50 is reported and indicative of 
the resistance profile of a certain drug. Based on the changes in IC50, cut-off values 

1 5 have been established to distinguish a sample from being sensitive or resistant to a 
certain drug. 

Various projects are underway to compile data relating to the correspondence of certain 
mutations with drug resistance phenotype, and these generally lead to the generation of 
relational databases of tables that illustrate the matching genotype / resistance 

20 phenotype for various antiretroviral drugs. Such databases bring together the 

knowledge of both a genotypic and phenotypic database. The phenotypic database 
contains phenotypic resistance values for HIV to at least one therapy, preferably 
multiple drug therapies. For example, the phenotypic resistance values of tested HIV 
viruses, with a fold resistance determination compared to the reference HTV virus (wild 

25 type). 

The dataset used herein is a dataset developed by the Applicant, which consists of a set 
of matching genotype / phenotype measurements with possible multiple phenotype 
measurements per genotype. However, any similar dataset may be used, provided that 
there are sufficient entries for each genotype / phenotype measurement for the data to 
30 be significant In the Virco dataset, the mutations are defined relative to HXB2 at 
amino acid level. 

The phenotypes are presented as pFR values, where pFR is equal to - log (FR), where 
FR denotes the Fold Resistance. Negative pFR values thus denote resistance and 
positive values denote hyper-susceptibility. For example, a pFR value of -1 .0 is equal 
35 to 10-fold resistance. An example of the pFR distribution for Saquinavir (SQV) is 
shown in Figure 3 . Figure 4 shows the pFR distribution for the "48V" mutation on 
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SQV. It is clear from this that the 48V subset does not behave the same as the whole 
dataset 

The problems of unwanted correlations between mutations where not all correlated 
mutations contribute to the drug resistance phenotype are illustrated in Figure 6. Here, 
5 the left hand panel shows the pFR distribution for the 711 mutation. When the effects 
of mutations 48V and 84V are removed (right hand panel), the pFR in the distribution 
of variants is markedly increased (less drug resistance). 

According to the invention, the predicted fold resistance of an HIV strain of a particular 
genotype may be calculated by summing the individual resistance contributions for 
10 each of the mutations or combinations of mutations in the mutation pattern of that 

genotype. The method uses linear regression models, so that the phenotype prediction, 
pFR is calculated in the following equation (1): 

pFR = $ A M A 4- $ B M B + — + § Z M Z +8 

15 The independent variables Ma , Mb , Mz, are referred to herein as mutation 

factors, each of which reflects the degree to which the mutation or combination of 
mutations is present in the HIV strain and, if present, whether or not the mutation is 
present in a mixture. 

The resistance coefficients fiA> fiB, fiZ represent the contribution to the total pFR 
20 prediction for each single mutation. 

Each mutation factor M t thus represents the presence or absence of the corresponding 
mutation and each coefficient fit represents the contribution to the pFR change for that 
specific mutation. 

The mutation factor may take into account 1 st order terms (single mutations) as well as 
25 2 nd order terms (the co-occurrence of two mutations) and in general n 1h order terms. 
For example, 2 nd order terms take the form: 

*AB M AB 

The independent variable MAB represents the co-occurrence of mutations A and B and 
the coefficient fiAB represents the synergy or antagonism between mutations A and B. 
30 When the mutation factor embraces n th order terms, thus the co-occurrence of two ore 

more mutations, the terms take the form: 

B M 
r n n 

wherein Mn represents the co-occurrence of one mutation with other one or more 
mutations -such as duplets, triplets, quadruples, etc. and the coefficient^ represents 
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the synergy or antagonism between the one mutation with the other one or more 
mutations; thus n will apply for instance to the combinations of mutations, AB, ABC, 
ABCD, BC, ACD, etc. 

As such, the linear regression model may take the following equation: 
5 pFR = $ A M A + V B M B + flM n +-4- p z il/ z + £ 

Higher order terms affect for interactions between mutations: 

• antagonism or reversal : positive pFR shifts for mutation couples. 

• synergy or enhancement: extra negative pFR shift for mutation couple. 
10 For example, consider the following (artificial) model: 



Mutation 


Coefficient 


84V 


-0.46 


50V 


-0.92 


54M 


-0.64 


88S 


0.63 


90M 


-0.16 


46L 


-0.19 


46L & 84V 


-0.09 



Consider a virus with following mutations: 31, 46L, 84V and 90M. Applying equation 
(1), 'this virus will have a pFR prediction: 

pFR = (3 46i .l + P g4F .l+ P 90M .1 + P 46W -1 = -0.9 

15 

or almost 8-fold resistance, i.e. pFR = -log/ 7 /?. 

Note that in the model F and A are synergistic since their co-occurrence decreases the 
pFR by an extra -0.09. 

The error term is £, which is the difference between the prediction and the 
20 measurement. This error term contains both the measurement error on the phenotype 
measurement and a model error (if the underlying model has higher order terms that 
are not taken into account in the regression model). 

Mutation factors for single mutations (Ma, Mb , Mz) are calculated as follows: 
if the mutation is present in the HIV strain, a positive mutation factor is assigned; 



WO 2004/111907 



PCT/EP2004/051084 



-10- 

if the single mutation is not present, the mutation factor assigned is zero; 

if the single mutation is present in a mixture, an averaged positive mutation factor is 
assigned. 

Conveniently, mutation factors range between 0 and 1 where 0 means not present and 1 
5 means present Values between 0 and 1 means that the mutation is present in a 
mixture. Accordingly, a positive mutation factor is assigned the value 1 . 

Mixtures are modelled as causing the average shift of its constituent mutations. Since 
methods for the quantitation of the precise proportions of mixtures to wild type are 
expensive and time-consuming, mixture with wild type may conveniently be treated as 
10 causing half the pFR shift of the resistance mutation (mutation factor = 0.5). However, 
as the skilled reader will appreciate, a more precise mutation iactor may be assigned if 
the true proportion in the mixture is known. 

Mutation factors for double mutations (MAB etc.) are calculated as follows; 

if both the mutations are present in the HIV strain, a positive mutation factor is 
15 assigned (conveniently, the value 1); 

if neither of the mutations are present, the mutation factor assigned is zero; 

if both mutations are present and one mutation is present in a mixture, an averaged 
positive mutation factor is assigned (conveniently, 0.5); 

if both mutations are present in a mixture, a reduced averaged positive mutation factor 
20 is assigned (in this example, 0.25). The factor 0.25 is the product of the M-factors of 
both the single constituent mutations. This is the result of the assumption that these 
mixtures are independent of each other. Of course, this is an approximation, since in a 
real blood sample, the mixtures are not independent of each other. For example, if only 
2 viruses were present, virus A (no mutations) for 70% and virus B (mutations 461 and 
25 84V) for 30%, then a mixture would be detected on both positions 46 and 84. If these 
concentrations were known, it would be possible to fine tune the mutation factor of 
0.25. If this information is not available, the best statistical guess is 0.5*0.5: this being 
the average value that would be measured for the mutation couple being present for a 
population of samples that have these mixtures on 46 and 84 in all possible 
30 concentrations. 

Similarly, the mutation factors for triple mutations (MABC etc.) shall be calculated as 
follows: 

if the three mutations are present in the HIV strain, a positive mutation factor is 
assigned (conveniently, the value 1); 
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if neither of the three mutations axe present, the mutation factor assigned is zero; 

if the three mutations are present and one mutation is present in a mixture, an averaged 
positive mutation factor is assigned (conveniently, 0.5); 

if the three mutations are present and two mutations are present in a mixture, a reduced 
5 averaged positive mutation factor is assigned (in this example, 0.25). The factor 0.25 is 
the product of the M-factors of the two single constituent mutations present in the 
mixture; 

if the three mutations are present in a mixture, a reduced averaged positive mutation 
factor is assigned (in this example, 0.125). The factor 0.125 is the product of the M- 
1 0 factors of the three single constituent mutations. 

The calculation of the mutation factors for higher order terms shall take the same 
principle. 

Calculation of the resistance coefficient (fiA, &B> ••> Pz> fiAB) is performed by 
evaluating the dataset for the drug phenotype reported for each mutation or 
15 combination of mutations. 

The problem of unwanted correlations has been discussed above. Unwanted 
correlations are removed according to the methods of the invention. 

One way to do this is to use an algorithm that has been developed by the inventors to 
track the change in pFR as the effects of individual mutations or combinations of 
20 mutations are removed from the dataset. The effect of each mutation or combination of 
mutations is thus separated out. The methodology follows mutation trajectories 
towards the global average as the effects of individual mutations or combinations of 
mutations are removed. The steps are as follows: 

a) calculate average pFR for all mutations with a sufficient count in the database to be 
25 significant; 

b) determine the extremes (maximum, minimum), and select the mutation with the 
pFR furthest away from the global average; 

c) remove all virus strains that have the selected mutation and reiterate from step a); 

d) stop when the selected mutation in step b) has an average pFR that approximates to 
30 the global average. 

In this manner, mutations that do not cause resistance, but which are often present with 
mutations that do cause resistance will have a higher average pFR (less resistance). 
Removing the virus strains with a certain resistance causing mutation results in an 
increase of the average pFR for correlating mutations. 
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A suitable threshold at which a count in the database becomes sufficiently significant 
will be apparent to the skilled reader and will be dependent on the database size. For 
example, thresholds of 5, 10, 15, 20, 25, 30 or more may be suitable. In the examples 
discussed herein, a threshold of 20 times was used. 

5 By an "average pFR that approximates to the global average" is meant that the average 

pFR is within a fraction of the standard deviation of the remaining population. A 
convenient fraction ranges between about 0.3 and 0.5. 

A comparison of the change in the global average pFR with the change in the average 
pFR for selected mutations with increasing iterations of the algorithm is shown in 
10 Figure 7. Figure 8 shows an example, where the average pFR for 711 (unwanted 

correlation) jumps up as a result of removing from the dataset virus strains that have 
"711 & 84V" and "48V" mutations. 

An alternative, analogous methodology for removing unwanted correlations is as 
follows; this is an extension of the mutation trajectories algorithm discussed above. 
15 The steps of this method are as follows: 

a) calculate correlation coefficient between all mutations (with a sufficient count in 
the database) and the pFR; 

b) determine the extremes (maximum, minimum), and select the mutation with the 
highest (absolute value of) correlation coefficient; 

20 c) calculate a linear model for the pFR with the selected mutation(s) (from step b), all 
previous iterations); 

d) take the residue (pFR minus the predicted value from the model); 

e) calculate correlation coefficient between all mutations (with a sufficient count in 
the database) and the residue; 

25 i) determine the extremes (maximum, minimum), and select the mutation with the 
highest (absolute value of) correlation coefficient; 

g) calculate a linear model for the pFR with the selected mutation(s) (from step f), all 
previous iterations); and 

h) reiterate from step d); 

30 i) stop when the selected mutation in step g) has a correlation coefficient that 
approximates to zero. 
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As with the mutation trajectories algorithm described above, the effect of mutations 
that do not themselves cause resistance, but which are often present with mutations that 
do cause resistance, is excluded and thus does not distort the real values. 

In a more preferred methodology for removing unwanted correlations, a stepwise 
5 selection regression may be applied, which method selects the variable with the highest 

effect. The steps of this method are as follows: 

a) perform a first order regression from the list of mutations that occur in the dataset; 

b) calculate the p-value for all mutations; 

c) select the mutation with the lowest p-value and add it to the model; 
10 d) re-calculate the regression model; 

e) reiterate from step b); 

f) stop when the re-calculation of the p-values of step b) gives no significant values 
anymore. 

Usually, this methodology is run in statistical software packages, which iteratively 
15 model the residue from the previous regression as the dependent variable. 

pFR = Intercept, + fij^j +£ i 

E t = Intercept 2 + P^M^ -he 2 

20 \ 

s 2 — Intercept 3 + $ n M n +£ 3 

1 



The p-value for a given mutation is the probability of rejecting the true null hypothesis, 
25 where the null hypothesis is defined as follows: the coefficient of that parameter equals 
zero. In other words, the p-value is the probability that the real coefficient for a certain 
parameter is zero, while the model predicts a coefficient different from zero. 

The expression "significant value" for the p-values refers to the mutations with a p- 
value that is lower than the threshold selected by the user. This threshold may be 
30 determined as follows: the user shall create linear models for a whole range of 

combinations of p-values (a p-value for the first-order iteration and a p-value for the 
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second-order iteration). For each combination, the mean squared error (MSE) of the 
corresponding model is calculated on unseen data. The combination of p-values that 
results in the model with the lowest MSE, i.e. the combination for which the model 
gives the best predictions, is chosen. 

5 In farther preferred embodiments of the invention, problems of small datasets for 

particular mutations or combinations of mutations are dealt with by applying the 
method recursively to the set of virus strains that exhibit those particular mutations or 
combinations of mutations. 

In still farther preferred embodiments of the invention, the following additional 
1 0 correlations are taken into account: 

• multiple entries of the same virus strain (or virus strains grown from the same 
stock solution) that cause unwanted correlations; 

• censored values in genotype / phenotype database (for example, EC50 value = 
'< IjllM'). These are phenotypes beyond the assay range, thus when the 

1 5 phenotypic value is smaller than the measurable range, a *<'-censor is applied to 

that value. Analogously, a c >'-censor is applied to the value, if it is higher than the 
measurable range. 

Preferably, censored values are dealt with by attempting to construct a model that is 
consistent from extrapolations. Censored values are thus modeled by replacing the 
20 censored value by a maximum likelihood estimation, assuming knowledge of the 

standard deviation of the measurement error. 

A preferred technique for the generation of a maximum likelihood estimation is as 
follows: 

a) calculate a linear regression model without censored values; 

25 b) use the phenotypic measured value Vo as if the censor was " = e.g. when a result 
is expressed as -log FR < 4, we will treat Vo as -log FR =4; 

c) look at the prediction P from the model and apply either: 

Case -censor: 

■ P < Vo - 0.798 a (center of gravity of half Gaussian distribution) 
30 o Remove value from training data for next iteration 

■ Vo-0.798o<P<V 0 

o Use V = V 0 - 0.798 o for next iteration 

■ V 0 <P 
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o Use V* centre of gravity of tail (<V) of a normal distribution N (P, o) as 
value for next iteration. 

Case 6 >'-censor: 

■ P > Vo + 0.798 a (center of gravity of half Gaussian distribution) 
5 o Remove value from training data for next iteration 

■ V 0 + 0.798o>P>V 0 

o Use V* = Vo - 0.798 a for next iteration 

■ V 0 >P 

o Use V centre of gravity of tail (>V) of a normal distribution N (P, g) as 
1 0 value for next iteration. 

d) calculate a linear regression model and for the censored values in the linear 
regression model, either remove the data-point from the training set, or use V* 
instead of the censored phenotypes measurement, as described in step c); 

e) re-iterate from step b) until the prediction converges. 

1 5 Accordingly, for each iteration, when the prediction and measurement contradict, 

censored values are taken into account. When the prediction and measurement are 
strongly consistent, censored values are disregarded, on the basis that no further 
information is provided and their inclusion has no additional value. 

In one preferred embodiment of this aspect of the invention, the number of calculations 
20 necessary in the linear regression analysis may be reduced. The computational power 
and memory requirement that is currently generally available is insufficient to allow a 
full second order model to be evaluated for a large dataset, based on all possible single 
mutations and second order terms, since the number of terms increases quadratically 
with the number of mutations considered. This number increases with a larger dataset 
25 since more rare mutations are in a large database. 

In order to reduce the amount of terms, a first order regression may be performed from 
the list of mutations that occur in the dataset above a threshold number of times. A 
suitable threshold at which a count in the database becomes sufficiently significant will 
be apparent to the skilled reader and will be dependent on the database size. For 
30 example, thresholds of 5, 10, 15, 20, 25, 30 or more may be suitable. In the examples 

discussed herein, a threshold of 20 times was used. The significant terms from this first 
order regression are withheld and the list of these terms is then used to perform a 
second order regression. In the second order regression only the single mutations and 
combinations of mutations are used that were found significant in the first order model. 
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Again, a threshold significance will be apparent to the skilled reader - an example is if 
the probability that the real value of the term is 0, is smaller than 0.001. 

For example, a first order regression performed on the matching genotype /phenotype 
dataset for indinavir (34,445 measurements) for those mutations that occur at least 20 
5 times results in a first order model that withholds a list of 94 single mutations that are 
considered significant. 

This list is then used as a starting list for a second order regression. It should be noted 
that it may be advantageous to exclude certain very common mutations from the 
calculation. 31 is one example. The reason is that a mutation must occur at least a 
10 threshold number of times and the inverse also has to be true: the count of viruses not 
having the mutation 31 or the couple not 31 and another mutation should also be above 
the threshold value (e.g. 20). Taking this into account results in excluding 31 from the 
regression in practice. 

In the second order regression, all the single mutations and all couples of mutations 
1 5 from the list are used as potential terms. The significant terms are then withheld by the 
regression algorithm. 

According to a further aspect of the invention;, there is provided a method of calculating 
the quantitative contribution of a mutation pattern to the drug resistance phenotype 
exhibited by an HIV strain, said method comprising the steps of: 

20 a) obtaining a genetic sequence of said HIV strain; 

b) identifying the pattern of mutations in said genetic sequence, wherein said mutations 
are associated with resistance or susceptibility to drug therapy; and 

c) calculating the fold resistance of the HIV strain as compared to the wild type HIV 
strain by performing a linear regression analysis, whereby the log fold resistance, pFR, 

25 is modelled as the sum of all the individual resistance contributions for each of the 

mutations or combinations of mutations that occur in said HIV strain according to the 
following equation; 

pFR = § A M A + JJgMg +••• + P Z M Z +e 

wherein each individual resistance contribution is calculated by multiplying a mutation 
30 factor, Ma > Mb , . Mz, for each mutation or combination of mutations by a 
resistance coefficient pA, PB, ~, fiZl 

wherein the mutation factor assigned reflects the degree to which the mutation or 
combination of mutations is present in the HIV strain and, if present, to which degree 
the mutation is present in a mixture; 
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wherein each resistance coefficient reflects the contribution of the mutation ox 
combination of mutations to the fold resistance exhibited by the strain; 

and wherein the error term e ? represents the difference between the modelled prediction 
and the experimentally determined measurement. 

5 As the skilled reader will appreciate, the fold resistance of the HIV strain may be 
calculated using any one of the embodiments of the invention referred to above. 

In the first step of this method, the genetic sequence of an HIV strain should be 
obtained. Normally, this will be the genetic sequence of an HTV strain with which a 
patient is infected, although the sequence may be a theoretical sequence, for example 
10 for purposes of in silico modelling. 

The method may thus be used as a diagnostic method for predicting the fold resistance 
exhibited by a particular HTV strain with which a patient is infected. According to 
other preferred embodiments, the method may be used for assessing the efficiency of a 
patient's therapy or for evaluating or optimising a therapy. The method may be 
15 performed for each drug or combination of drugs currently being administered to the 
patient so as to obtain a series of drug resistance phenotypes and thus to assess the 
effect of a plurality of drugs or drug combinations on the predicted fold resistance 
exhibited by the HTV strain with which the patient is infected. 

A "patient" may be any organism, particularly a human or other mammal, suffering 
20 from HTV or AIDS or in need or desire of treatment for such disease. A patient 

includes any mammal and particularly humans of any age or state of development. 

To obtain an HTV strain from a patient, a biological sample will need to be obtained 
from the patient. A cc biological sample" may be any material obtained in a direct or 
indirect way from a patient containing HTV virus. A biological sample may be 
25 obtained from, for example, saliva, semen, breast milk, blood, plasma, faeces, urine, 
tissue samples, mucous samples, cells in cell culture, cells which may he ftirther 
cultured, etc. Biological samples also include biopsy samples. 

The genetic sequence of an HIV strain may be evaluated by a number of suitable 
means, as will be clear to those of skill in the art. Most suitable will be techniques that 
30 allow for specific nucleic acid amplification, such as the polymerase chain reaction 
(PCR), although other techniques such as restriction fragment length polymorphism 
(RFLP) analysis will be equally applicable. 

Nucleic acid sequencing then allows the analysis of the mutation pattern in a particular 
nucleic acid sequence, either by classical nucleic sequencing protocols e. g. extension 
35 chain termination protocols (Sanger technique; see Sanger F., Nicher., Coulson A. 
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Proc. Nat. Acad. Sci. 1977, 74, 5463-5467) or chain cleavage protocols. Such methods 
may employ such enzymes as the Klenow fragment of DNA polymerase I, Sequenase 
(US Biochemical Corp, Cleveland, OH), Taq polymerase (Perkin Elmer), thermostable 
T7 polymerase (Amersham, Chicago, IL), or combinations of polymerases andproof- 
5 reading exonucleases such as those found in the ELONGASE Amplification System 

marketed by Gibco/BRL (Gaithersburg, MD). Preferably, the sequencing process may 
be automated using machines such as the Hamilton Micro Lab 2200 (Hamilton, Reno, 
NV), the Peltier Thermal Cycler (PTC200; MJ Research, Watertown, MA) and the ABI 
Catalyst and 373 and 377 DNA Sequencers (Perkin Elmer). Particular sequencing 

10 methodologies have been developed further by companies such as Visible Genetics. 

Any of the novel approaches developed for unraveling the sequence of a target nucleic 
acid, either now or in the future will be perfectly applicable to the analysis of sequence 
in the present invention (including but not limited to mass spectrometry, MALDI-TOF 
(matrix assisted laser desorption ionization time of flight spectroscopy) (see Graber J, 

15 Smith C, Cantor C. Genet. Anal. 1999, 14, 215-219) chip analysis (hybridization based 

techniques) (Fodor S P ; Rava R P ; Huang X C ; Pease A C ; Holmes C P ; Adams C L 
Nature 1993, 364, 555-6) It should be appreciated that nucleic acid sequencing covers 
both DNA and RNA sequencing. 

Once the genetic sequence of the HIV strain is known, the pattern of mutation must be 
20 identified in the sequence. The term Ci mutation" as this is used herein, encompasses 
both genetic and epigenetic mutations of the genetic sequence of wild type HIV. A 
genetic mutation includes, but is not limited to, (i) base substitutions: single nucleotide 
polymorphisms, transitions, transversions, substitutions and (ii) frame shift mutations: 
insertions, repeats and deletions. Epigenetic mutations include, but are not limited to, 
25 alterations of nucleic acids, e. g., methylation of nucleic acids. One example includes 
(changes in) methylation of cytosine residues in the whole or only part of the genetic 
sequence. In the present invention, mutations will generally be considered at the level 
of the amino acid sequence, and comprise, but are not limited to, substitutions, 
deletions or insertions of amino acids. 

30 The "control sequence" or "wild type" is the reference sequence from which the 

existence of mutations is based. A control sequence for HIV is HXB2. This viral 
genome comprises 9718 bp and has an accession number in Genbank at NCBI M38432 
or K03455 (gi number : 327742). 

Identifying a mutation pattern in a genetic sequence under test thus relates to the 
35 identification of mutations in the genetic sequence as compared to a wild type 

sequence, which lead to a change in nucleic acids or amino acids or which lead to 
altered expression of the genetic sequence or altered expression of the protein encoded 
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by the genetic sequence or altered expression of the protein under control of said 
genetic sequence. 

A "mutation pattern" comprises at least one mutation influencing sensitivity of HIV to 
a therapy. As such, a mutation pattern may consist of only one single mutation. 
5 Alternatively, a mutation pattern may consist of at least two, at least three, at least four, 
at least five, at least six, at least seven, at least eight, at least nine or at least ten or more 
mutations. A mutation pattern is thus a list or combination of mutations or a list of 
combinations of mutations. A mutation pattern of any particular genetic sequence may 
be constructed, for example, by comparing the tested genetic sequence against a wild 
10 type or control sequence. The existence of a mutation or the existence of one of a 
group of mutations can then be noted. 

One way in which this may be done is by aligning the genetic sequence under test to a 
wild type sequence noting any differences in the alignment. Typical alignment 
methods include Smith- Waterman (Smith and Waterman, (1981) J Mol Biol, 147: 195- 

15 197), Blast (Altschul et al (1990) J Mol Biol., 215(3): 403-10), FASTA (Pearson & 

Lipman, (1988) Proc Natl Acad Sci USA; 85(8): 2444-8) and, more recently, PSI- 
BLAST (Altschul et al (1997) Nucleic Acids Res., 25(17): 3389-402). It may in some 
circumstances be preferable to generate alignments using a multiple alignment 
program, such as ClustalW (Thompson et al, 1994, NAR, 22(22), 4673-4680). Other 

20 suitable methods will be clear to those of skill in the art (see also "Bioinformatics: A 

practical guide to the analysis of genes and proteins" Eds. Baxevanis and Ouellette, 
1998, John Wiley and Sons, New York). A practical example of multiple sequence 
alignment is the construction of a phylogenetic tree. A phylogenetic tree visualizes the 
relationship between different sequences and can be used to predict future events and 

25 retrospectively to devise a common origin. This type of analysis can be used to predict 

a similar drug sensitivity for a sample but also can be used to unravel the origin of 
different patient sample (i. c. the origin of the viral strain). 

In this manner, therefore, the pattern of mutations in the genetic sequence can be 
identified, wherein said mutations are associated with resistance or susceptibility to 

30 drug therapy exhibited by the HIV strain tested. The mutation pattern may influence 
sensitivity to a specific therapy, e. g., a drug, or a group of therapies. The mutation 
pattern may, for example, increase and/or decrease resistance of the HIV strain to a 
therapy. Particular mutations in the mutation pattern, may also, for example, enhance 
and/or decrease the influence of other mutations present in the genetic sequence that 

35 effect sensitivity of the HIV strain to a therapy. 
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The invention further relates to a diagnostic system as herein described for use in any 
of the above described methods. An example of such a diagnostic system, for 
quantitating the individual contribution of a mutation or combination of mutations to 
the drug resistance phenotype exhibited by an HIV strain, comprises: 

5 a) means for obtaining a genetic sequence of said HTV strain; 

b) means for identifying the mutation pattern in said genetic sequence as compared to 
wild type HIV; 

c) means for predicting the fold resistance exhibited by the HIV strain using any one of 
the methods described above. 

10 The means for predicting the fold resistance are preferably computer means. 

A still farther aspect of the invention relates to a computer apparatus or computer-based 
system adapted to perform any one of the methods of the invention described above, for 
example, to quantify the individual contribution of a mutation or combination of 
mutations to the drug resistance phenotype exhibited by HIV, or to calculate the 
1 5 quantitative contribution of a mutation pattern to the drug resistance phenotype 

exhibited by an HIV strain. 

In a preferred embodiment of the invention, said computer apparatus may comprise a 
processor means incorporating a memory means adapted for storing data; means for 
inputting data relating to the mutation pattern exhibited by a particular HTV strain; and 
20 computer software means stored in said computer memory that is adapted to perform a 
method according to any one of the embodiments of the invention described above and 
output a predicted quantified drug resistance phenotype exhibited by an HIV strain 
possessing said mutation pattern. 

A computer system of this aspect of the invention may comprise a central processing 
25 unit; an input device for inputting requests; an output device; a memory; and at least 

one bus connecting the central processing unit, the memory, the input device and the 
output device. The memory should store a module that is configured so that upon 
receiving a request to quantify the individual contribution of a mutation or combination 
of mutations to the drug resistance phenotype exhibited by HTV, or to calculate the 
30 quantitative contribution of a mutation pattern to the drug resistance phenotype 

exhibited by an HTV strain, it performs the steps listed in any one of the methods of the 
invention described above. 

In the apparatus and systems of these embodiments of the invention, data may be input 
by downloading the sequence data from a local site such as a memory or disk drive, or 
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alternatively from a remote site accessed over a network such as the internet. The 
sequences may be input by keyboard, if required. 

The generated results may be output in any convenient format, for example, to a 
printer, a word processing program, a graphics viewing program or to a screen display 
5 device. Other convenient formats will be apparent to the skilled reader. 

The means adapted to quantify the individual contribution of a mutation or combination 
of mutations to the drug resistance phenotype exhibited by HIV, or to calculate the 
quantitative contribution of a mutation pattern to the drug resistance phenotype 
exhibited by an HIV strain will preferably comprise computer software means. As the 
10 skilled reader will appreciate, once the novel and inventive teaching of the invention is 
appreciated, any number of different computer software means may be designed to 
implement this teaching. 

According to a still farther aspect of the invention, there is provided a computer 
program product for use in conjunction with a computer, said computer program 

1 5 comprising a computer readable storage medium and a computer program mechanism 
embedded therein, the computer program mechanism comprising a module that is 
configured so that upon receiving a request to quantify the individual contribution of a 
mutation or combination of mutations to the drug resistance phenotype exhibited by 
HTV, or to calculate the quantitative contribution of a mutation pattern to the drug 

20 resistance phenotype exhibited by an HIV strain, it performs the steps listed in any one 
of the methods of the invention described above. 

The invention further relates to systems, computer program products, business 
methods, server side and client side systems and methods for generating, providing, and 
transmitting the results of the above methods. 

25 The invention will now be described by way of example with particular reference to a 

specific algorithm that implements the process of the invention. As the skilled reader 
will appreciate, variations from this specific illustrated embodiment are of course 
possible without departing from the scope of the invention. 



30 
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BRIEF DESCRIPTION OF THE FIGURES 

Figure 1 : Overview of measured /predicted phenotype handling 

Figure 2: Phenotype distribution of ritonavir for matching G/P samples in Virco 
database 

5 Figure 3 : pFR distribution for saquinavir 

Figure 4: Distribution of pFR for '48V mutation on saquinavir 

Figure 5: Distribution of pFR for '48 V mutation on saquinavir (expanded) 

Figure 6: Removing unwanted correlations 

Figure 7: global mutation trajectories 

10 . Figure 8: mutation trajectories for 711 

Figure 9: Example of genotypes, mutations relative to HBX2 

Figure 10: Example of phenotype analysis for ritonavir 

Figure 1 1 : Higher order interaction between mutations 82 A and 84V 

Figure 12: Illustration of iterative procedure for censored values 

15 Figure 13: Linear regression model identifies mutations included in IAS list. Mutations 
marked with an * are also identified by a regression on a 5% subset of the data 

Figure 14: Linear regression model identifies additional mutations previously described 
in the literature 

Figure 15: Predicted versus measured log(FC) 

20 Figure 16: Comparison between linear regression model and decision trees. 

Figure 17: Histogram of population left after removing all virus strains during the 
iterations 

Figure 18: Trajectory of mutation 18H 

Figure 19: Residues as a function of the measured values 

25 Figure 20: Histogram of the residues as a function of the measured values 

Figure 21 : Histogram of the residues as a function of the measured values after 6 
parameters were taken into account 
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EXAMPLES 

Example 1: Methodology 

1*1 Introduction 

This exercise involved the generation of a list of key mutations for each of the 
5 following drugs: Indinavir, Ritonavir, Saquinavir, Nelfinavir, Amprenavir, Lopinavir, 

Zidovudine, Didanosine, Zalcitabine, Stavudine, Abacavir, Lamivudine, Tenofovir, 
Nevirapine, Delavirdine and Efavirenz. 

The obtained list of key mutations is derived from a linear regression model using 
single mutations and couples of mutations as independent variables. The dataset used 
10 for this analysis is an export of the Virco dataset at 2003/02/01 from the vircomining 
tables. Table 1 shows the matching geno/pheno counts for each drug {each phenotype 
measurement for a genotype counts as one measurement). 

Table 1: matching geno/pheno counts 



Drug 


Count 


Drug 


Count 


Drug 


Count 


Amprenavir 


29,508 


Lamivudine 


34,395 


Delavirdine 


32,450 


Indinavir 


34,445 


Abacavir 


32,744 


Efavirenz 


32,601 


Lopinavir 


7,410 


Stavudine 


34,420 


Nevirapine 


34,738 


Nelfinavir 


34,470 


Zalcitabine 


34,539 






Ritonavir 


34,502 


Didanosine 


34,227 






Saquinavir 


34,543 


Tenofovir 


14,591 










Zidovudine 


33,575 







15 1.2 Dataset 

The used dataset consists of a set of matching genotype/phenotype measurements with 
possible multiple phenotype measurements per genotype. The mutations are defined 
relative to HXB2 at amino acid level. The phenotypes are presented as pFR values, 
which is equal to - log (FR), where FR denotes the Fold Resistance. 

20 Negative pFR values denote resistance and positive values denote hyper-susceptibility. 
For example, a pFR value of -1,0 is equal to 10-fold resistance. 

13 Linear regression 

For example, consider the following (artificial) model: 



25 
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Table 2 



Mutation 


Coefficient 


84V 


-0.46 


50V 


-0.92 


54M 


-0.64 


88S 


0.63 


90M 


-0.16 


46L 


-0.19 


46L & 84V 


-0.09 



Consider a virus with following mutations: 31, 46L, 84V and 90M. This virus will have 
a pFR prediction: 

5 P FR = P 46i .l + P g4F .l + P 90M .1+ e 46i;84r l = -0-9 

or almost 8-fold resistance. Note that in the model 46L and 84V are synergistic since 
their co-occurrence decreases the pFR by an extra - 0.09. Note that in the model the 
mutation 31 shows no resistance coefficient assigned and therefore it is not considered 
10 in the pFR prediction equation. 

Figure 9 shows an example of four different genotypes (mutations relative to HBX2), 
whilst Figure 10 shows an example of phenotype analysis for RTV performed 
according to the method of the invention. 

15 1.4 Model creation 

Using our facilities, it was computationally infeasible to calculate a full second order 
model on all possible mutations and second order terms, since the number of terms 
increases quadratically with the number of mutations considered. 

Kg.forAPV: 

20 • Total number of occurring mutations and couples of mutations: 1 9,074 

• mutations and couples with each at least 20 measurements: 4,107 

In order to reduce the amount of terms, a first order regression was performed from the 
list of mutations that occur at least 20 times in the dataset. The significant terms from 
this regression were withheld and the list of these terms -except mutation 31 for some of 
25 the PPs, was used to perform a second order regression. A term is called significant if 

the probability that the real value of the term is 0, is smaller than 0.001 . A mutation 
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must occur at least 20 times and the inverse also has to be true: the count of viruses not 
having the mutation 31 or the couple not 31 and another mutation should also be at least 
20. Taking this into account results in excluding 31 from the regression in practice.In 
the second order regression only the single mutations and couples of mutations are used 
5 that were significant in the first order model. 

1.5 Example of model creation: Indinavir 

A first order regression is performed on the matching geno/pheno dataset (34,445 
measurements of which 28,480 unique Virco IDs) for those mutations that occur at 
10 least 20 times. The resulting first order model withholds a list of 94 single mutations 

that are considered significant. This list (except 31) is used as a starting list for a 
second order regression. In this second order regression, all the single mutations and 
all couples of mutations from the list are used as potential terms. The significant terms 
are withheld by the regression algorithm. 

15 

1.6 The impact of cross-drug correlation on the significance level of mutations 

Correlation between mutations that cause resistance to different drugs, has an impact on 
the confidence of the coefficient for this mutation. One of the effects is that for non- 
nucleoside reverse transcriptase inhibitors (NNRTIs) and nucleoside reverse 
20 transcriptase inhibitors (NRTIs), some non-relevant mutations for that drug appear as 
significant (though with a coefficient close to 0), because drug resistance to the drug is 
correlated with drug resistance to drugs that bind at a different place. 

Note that this is only a problem for interpretation of the model. For prediction of the 
Fold Resistance, the resulting model remains a good pFR predictor. 

25 

1.7 Effects of second order terms 
• Antagonism 

Table 3 



Parameter 


pFR shift 


Count 








82A & 84V 


0.43 


395 








82A 


-0.27 


4845 








84V 


-0.26 


3531 
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Second order terms can indicate a synergy or an antagonism. In the example above, the 
occurrence of either 82A or 84V cause a resistance shift, but the co-occurrence of both 
mutations almost completely cancels out the effect of both mutations and shifts to 
susceptible ranges. In case both mutations are present, the net pFR shift is only -0.43, 
5 while it is -0.26 or -0.27 if only one of the mutations are present. This is an example of 

strong antagonism. 

• Synergy 

Table 4 



Parameter 


pFR shift 


Count 








241 


-0.22 


1022 








24I&73S 


-0.48 


30 








73S 


-0.20 


2216 









10 In this example, 241 and 73 S both cause a resistance shift, but their co-occurrence 

causes a strong extra shift towards resistance. When only one of the mutations is 
present, the pFR shift is -0.20 or -0.22, but the presence of both mutations causes a pFR 
shift of -0.48. 241 and 73S are thus strongly synergistic in this example. 

• Enhancement 

15 Table 5 



Parameter 


pFR shift 


Count 








321 


0 


821 








321 & 82A 


-0.26 


516 








82A 


-0.27 


4845 









321 by itself does not contribute to resistance, but it increases the resistance for an 82A 
mutation. 321 enhances the effect of the 82A mutation. 

An example of the effects of higher order interactions is shown in Figure 11. 

20 
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1.8 Highly correlated mutations 

Highly correlated mutations (i.e. mutations that almost always co-occur in a strain) can 
affect the results of a regression analysis For example, when one of these 2 mutations 
has an effect on resistance and the other mutation does not (this mutation might for 
5 example be highly correlated with the resistance mutation because it affects the 

replication rate of the virus), the effect can be assigned to either one of the mutations. 
Unless this is compensated for, the regression model will assign the effect to that 
mutation that reduces the prediction error the most, which might not always be the 
mutation that is biologically responsible for the effect. Due to the correlation, it would 
10 otherwise not be possible to distinguish between these mutations. 

Another effect that occurs due to correlation is when a mutation is highly correlated 
with a pair of mutations in which the first mutation is present 

Table 6 



Parameter 


pFR shift 


Count 








58N 


-1.47 


108 








58N & 77L 


1.16 


106 








77L 


0 


471 









15 In the above example, 108 samples have a 58N mutation and out of these, 106 samples 
also have a 77L mutation. The effect of a pure 58N mutation can only be derived from 
the samples that have 58N and do not have 77L, which leads to higher uncertainty on 
the estimated pFR shift of the 58N mutation. The couple-term '58N & 77L' will 
compensate for a too low estimation of 58N by having a too high estimation for its pFR 

20 shift. 

Techniques are provided in the description to deal with these effects. The algorithm 
developed by the inventors tracks the change in pFR as the effects of individual 
mutations or combinations of mutations are removed from the dataset. 
A comparison of the change in the global average pFR with the change in the average 
25 pFR for selected mutations with increasing iterations of the algorithm is shown in 
Figure 7. Figure 8 shows an example, where the average pFR for 711 (unwanted 
correlation) jumps up as a result of removing from the dataset virus strains that have 
"711 & 84V" and "48V" mutations. 
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Example 2: Illustration of a stepwise regression with amprenavir 

In a dataset of 31,292 matching genotypes andphenotypes for amprenavir; a stepwise 
first order regression was performed, and the first 1 1 iterations are shown here. The 
inventors selected as p-values: 
5 p-value entry = 0.00 1 
p-value stay = 0.5 

After the first iteration all the variables with mutations found more than 20 times were 
selected. In the next step the p-value was calculated, and then the algorithm picked the 
variable with the lowest p-value. In this case it was P084V, and then a model was built 
10 with this variable (84V). The model is shown in 

Table 7. 

Variable P084_V Entered: R-Square = 0.2477 and C(p) = 43445.43 



Table 7 



Analysis of Variance 


Source 


DF 


Sum of Squares 


Mean Square 


F Value 


Pr>F 


Model 


1 


2042.55324 


2042.55324 


10301.6 


<.0001 


Error 


31289 


6203.83650 


0.19828 






Corrected Total 


31290 


8246.38974 









15 



Variable 


Parameter Estimate 


Standard Error 


Type II SS 


F Value 


Pr>F 


Intercept 


-0.00318 


0.00269 


0.27810 


1.40 


0.2363 


P084_V 


-0.81754 


0.00805 


2042.55324 


10301.6 


<.0001 



In the next iteration, we repeated the previous process except that the influence of 84V 
is now removed. In this second run, the mutation with the lowest p-values was P082A. 
The model is shown in 

20 Table 8 below. 

Variable P082_A Entered: R-Square = 0.3538 and C(p) = 32908.89 



Table 8 



Analysis of Variance 


Source 


DF 


Sum of Squares 


Mean Square 


F Value 


Pr>F 


Model 


2 


2917.39937 


1458.69968 


8564.44 


<.0001 
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Analysis of Variance 


Source 


DF 


Sum of Squares 


Mean Square 


F Value 


Pr>F 


Error 


31288 


5328.99038 


0.17032 






| Corrected Total 


31290 8246.38974 









Variable 


Parameter Estimate 


Standard Error 


Type II SS 


F Value 


Pr>F 


Intercept 


0.07033 


0.00269 


116.28598 


682.75 


<.0001 


P082_A 


-0.47905 


0.00668 


874.84612 


5136.47 


<.0001 


P084_V 


-0.82827 


0.00747 


2095.67091 


12304.3 


<.0001 



10 



In the next iteration, we repeated the previous process except that the influence of 84V 
and 82A is now removed. In this third run, the mutation with the lowest p-values was 
P090M. 

It may happen that after some iterations, a mutation which was found first significant is 
not significant anymore, and as such it is removed from the model. 

The resistance coefficient is adjusted after every iteration because of the addition of a 
new variable to the regression. E.g. for P84V, the resistance coefficient p changes from 
-0.81754 to -0.82827. 

The following iterations were done in the same way. The results obtained are here 
below enclosed. 

Variable P090JA Entered: RSqaare = 0.4245 and C(p) = 25885. 06 
Table 9 



15 



Analysis of Variance 


Source 


DF 


Sum of Squares 


Mean Square 


F Value 


Pr>F 


Model 


3 


3500.64130 


1166.88043 


7692.82 


<.0001 


Error 


31287 


4745.74844 


0.15168 






Corrected Total 


31290 


8246.38974 










Variable 



Parameter Estimate 



Standard Error 



Type II SS 



F Value 



?r>F 
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Variable II Parameter Estimate 


Standard Error 


Type II SS 


F Value 


1 ~ „ 
Pr>F 


Intercept 


0.13680 


0.00276 


373.40964 


2461.75 


<.0001 


P082_A 


-0.40431 


0.00642 


601.20353 


3963.52 


<0001 


P084_V 


-0.64830 


0.00762 


1097.72370 


7236.89 


<.0001 


P090_M 


-0.33549 


0.00541 


583.24194 


3845.10 


<.0001 



Variable P033_F Entered: R-Square = 0.4729 and C(p) = 21082.65 



Table 10 


Analysis of Variance 


Source 


DF 


Sum of Squares 


Mean Square 


F Value 


Pr>F 


Model 


4 


3899.47454 


974.86863 


7016.41 


<.0001 


Error 


31286 


4346.91521 


0.13894 






Corrected Total 


31290 


8246.38974 









Variable 


Parameter Estimate 


Standard Error 


Type II SS 


F Value 


Pr>F 


Intercept 


0.14140 


0.00264 


398.56350 


2868.58 


<.0001 


P033_F 


-0.60263 


0.01125 


398.83323 


2870.52 


<.0001 


P082_A 


-0.35755 


0.00621 


460.87758 


3317.07 


<.0001 


P084_V 


-0.60772 


0.00733 


954.28785 


| 6868.28 


<.0001 


P090_M 


-0.30702 


0.00521 


483.38315 


, 3479.05 


<.0001 



5 

Variable P046J Entered: R-Square = 0.5110 and C(p) = 17296.94 
Table 11 



Analysis of Variance 


Source 


DF 


Sum of Squares 


Mean Square 


F Value 


Pr>F 


Model 


5 


4213.90735 


842.78147 


6538.51 


<.0001 


Error 


31285 


4032.48240 


0.12890 






Corrected Total 


31290 


8246.38974 
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Variable 


Parameter Estimate 


Standard Error 


Type iS SS 


F Value 


Pr>F 


Intercept 


0.15801 


0.00257 


489.12701 


3794.77 


<0001 j 


P033JF 


-0.59310 


0.01084 


386.19290 


2996.18 


<booi 


P046 I 


-0.32298 


0.00654 


314.43281 


2439.45 


<0001 


1 P082_A 


-0.32721 


0.00601 


381.95629 


2963.31 


<.0001 


P084_V 


-0.53666 


0.00721 


714.53640 


5543.55 


<.0001 1 


1 P090_M 


-0.25737 


0.00511 


326.53882 


2533.37 


<0001 



Variable P047_V Entered: R-Square = 0.5287 and C(p) = 15544.70 
Table 12 



Analysis of Variance 


Source 


DF 


Sum of Squares 


Mean Square 


F Value 


Pr>F 


Model 


6 


4359.53390 


726.58898 

, 


5848.07 


<.0001 


Error 


31284 


3886.85584 


0.12424 






Corrected Total 


31290 


8246.38974 









5 



Variable 


Parameter Estimate 


Standard Error 


Type II SS 


F Value 


Pr>F 


Intercept 


0.15941 


0.00252 


497.68905 


4005.73 


<0001 


P033_F 


-0.55617 


0.01069 


336.13339 


2705.42 


<.0001 


P046_I 


-0.27816 


0.00655 


223.90478 


1802.13 


<.0001 


P047_V 


-0.63671 


0.01860 


145.62656 


1172.10 


<.0001 


P082_A 


-0.32763 


0.00590 


382.93722 


3082.13 


<.0001 


P084_V 


-0.54696 


0.00708 


740.88446 


5963.13 


<.0001 


P090_M 


-0.25573 


0.00502 


322.35883 


2594.56 


<.0001 



Variable P046_L Entered: R-Square = 0.5409 and C(p) = 14326.32 
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Table 13 



Analysis of Variance 


Source 


DF 


Sum of Squares 


Mean Square 


F Value 


Pr>F 


Model 


7 


4460.84208 


637.26315 


5266.21 


<0001 


Error 


31283 


3785.54767 


0.12101 






Corrected Total 


31290 


8246.38974 









Variable 


Parameter Estimate 


Standard Error 


Type II SS 


F Value 


Pr>F 


Intercept 


0.16438 


0.00249 


526.67853 


4352.36 


<.0001 


P033_F 


-0.54921 


0.01056 


327.61200 


2707.32 


<0001 


P046_I 


-0.31345 


0.00658 


274.55948 


2268.90 


<.0001 


P046_L 


-0.27769 


0.00960 


101.30817 


837.19 


<.0001 


P047_V 


-0.63940 


0.01835 


146.85706 


1213.60 


<.0001 


P082_A 


-0.26575 


0.00620 


222.00011 


1834.56 


<.0001 


P084_V 


-0.52972 


0.00702 


689.88420 


5701.06 


<.0001 


P090_M 


-0.24267 


0.00498 


287.89278 


2379.09 


<.0001 



Variable P050_V Entered: R-Square = 0.5534 and C(p) = 13094.82 



Table 14 



Analysis of Variance 


Source 


DF 


Sum of Squares 


Mean Square 


F Value 


Pr>F 


Model 


8 


4563.24026 


570.40503 


4844.61 


<.0001 


Error 


31282 


3683.14948 


0.11774 






Corrected Total 


31290 


8246.38974 









Pr>Fj 



[ Variable |[ 



Parameter Estimate Standard Error 



Type II SS 



F Value 
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Variable 


Parameter Estimate 


Standard Error 


Type II SS 


F Value 


Pr>F 


Intercept 


0.16629 


0.00246 


538.66106 


4575.00 


<0001 


P033_F 


-0.51815 


0.01046 


288.64295 


2451.52 


<0001 


P046J 


-0.29956 


0.00651 


249.44262 


2118.58 


<0001 


P046_L 


-0.27934 


0.00947 


102.51249 


870.67 


<.0001 


P047_V 


-0.64754 


0.01811 


150.58308 


1278.94 


<.0001 


P050_V 


-0.82797 


0.02808 


102.39819 


869.70 


<.0001 


P082 A 


-0.25944 


0.00612 


211.32860 


1794.87 


<0001 


P084_V 


-0.53915 


0.00693 


713.14511 


6056.94 


<.0001 


P090_M 


-0.24415 


0.00491 


291.39382 


2474.89 


<.0001 



Variable P054JM Entered: R-Square = 0.5643 and C(p) = 12005. 72 
Table 15 



Analysis of Variance 



Source 


DF 


Sum of Squares 


Mean Square 


F Value 


Pr>F 


Model 


9 


4653.81644 


517.09072 


4502.38 


<.0001 


Error 


31281 


3592.57330 


0.11485 






Corrected Total 


31290 


8246.38974 









Variable 


Parameter Estimate 


Standard Error 


Type n SS 


F Value 


Pr>F 


Intercept 


0.16633 


0.00243 


538.92765 


4692.51 


<.0001 


P033_F 


-0.46793 


0.01049 


228.56387 


1990.14 


<.0001 


P046_I 


-0.30134 


0.00643 


252.40077 


2197.69 


<0001 


P046_L 


-0.28508 


0.00935 


106.71653 


929.19 


<.0001 


P047_V 


-0.55613 


0.01818 


107.50855 


936.09 


<.0001 


P050_V 


-0.84757 


0.02774 


107.23423 


933.70 


<.0001 
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Variable 


Parameter Estimate 


Standard Error 


Type II SS 


F Value 


Pr>F 


P054_M 


-0.57119 


0.02034 


90.57618 


788.66 


<0001 


P082_A 


-0.26050 


0.00605 


213.05431 


1855.09 


<.0001 


P084 V 


-0.53337 


0.00685 


697.31870 


6071.64 


<0001 


P090_M 


-0.23454 | 0.00486 


267.57375 


2329.80 


<.0001 



Variable P054_L Entered: RSquare = 0.5740 and C(p) = 11047.41 
Table 16 



Analysis of Variance 


Source 


DF 


Sum of Squares 


Mean Square 


F Value 


Pr>F 


Model 


10 


4733.53615 


473.35362 


4214.95 


<.0001 


Error 


31280 


3512.85359 


0.11230 






Corrected Total 


31290 


8246.38974 









Variable 


Parameter Estimate 


Standard Error 


Type II SS 


F Value 


Pr>F 


Intercept 


0.16756 


0.00240 


546.67520 


4867.84 
1407.76 


<.0001 


P033_F 


-0.40056 


0.01068 


158.09630 


<.0001 


P046_I 
P046_L 


-0.30750 


0.00636 


262.46469 


2337.10 


<.0001 
<.0001 


-0.28311 


0.00925 


105.23686 


937.08 


P047_V 


-0.52353 


0.01802 


94.83277 


844.43 


<.0001 


P050 V 


-0.87024 


0.02744 


112.94107 


1005.68 


<0001 


P054_L 


-0.45611 


0.01712 


79.71971 


709.86 


<0001 


P054_M 


-0.61432 


0.02018 


104.09593 


926.92 


<.0001 
<.0001 


P082_A 


-0.26465 


0.00598 


219.74203 


1956.68 


P084_V 


-0.51838 


0.00679 


654.14626 


5824.81 


<0001 


P090_M 


-0.22560 


0.00482 


246.35798 


2193.68 


<.0001 



5 

Variable P088JS Entered: R-Square = 0.5834 and C(p) = 10116.87 
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Tablel7 



Analysis of Variance 


Source 


DF 


Sum of Squares 


Mean Square 


F Value 


Pr>F 


Model 


11 


4810.94944 


437.35904 


3982.07 


<.0001 


Error 


31279 


3435.44030 


0.10983 






Corrected Total 


31290 


8246.38974 









Variable 


Parameter Estimate 


Standard Error 


Type n SS 


F Value 


Pr>F 


Intercept 


0.16239 


0.00238 


510.05266 


4643.93 


<.0001 


P033_F 


-0.39933 


0.01056 


157.11889 


1430.54 


<.0001 


P046_I 


-0.32619 


0.00633 


291.69184 


2655.80 


<0001 


P046_L 


-0.29089 


0.00915 


110.98928 


1010.54 


<.0001 


P047_V 


-0.50941 


0.01782 


89.70713 


816.77 


<.0001 


P050_V 


-0.86163 


0.02714 


110.70009 


1007.90 


<.0001 


P054_L 


-0.46062 


0.01693 


81.29492 


740.17 


<.0001 


P054_M 


-0.61674 


0.01995 


104.91704 


955.25 


<.0001 


P082_A 


-0.25645 


0.00592 


205.77424 


1873.53 


<.0001 


P084_V 


-0.51212 


0.00672 


637.66342 


5805.80 


<.O001 


P088_S 


0.57942 


0.02182 


77.41329 


704.83 


<.0001 


P090_M 


-0.22099 


0.00477 


236.06351 


2149.31 


<.0001 



Example 3: Dealing with censored values 

5 In this example, the method developed by the inventors to deal with censored values 
was applied for the drug amprenavir. Firstly, a linear regression model without 
censored values was calculated, see the values 'APVjpFR' for iteration 0 in the Tables 
18-21 below. The phenotypic measured valueis < -2.083062017 for Virus strain 1, for 
the first iteration, the value Vo is equal to the measured phenotype value APV_pFR, but 
10 the censor is considered as <= =\ This was followed by iteration nr. 1. Once the values 
were obtained from iteration 1, the inventors compared the prediction value P, e.g. for 
Virus strain 1, -2.362076895 with the phenotypic measured value <-2.083062017. For 
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virus strains 1, 2 and 3 below, the measured values have a censor c <\ For virus strains 
4, the measured value has a censor 6 >\ The scenarios established by the inventors, 
when the case was ^'-censor, and when the case was -censor, were applied. New 
linear regression models were calculated and for the censored values in the linear 
5 regression model, either the data-points from the training set were removed, as for virus 
strains 1, 2 and for virus strain 4 (iteration 2 and 3 only), or those data-points were used 
instead of the censored phenotypes measurement, as illustrated for virus strain 3 and for 
virus strain 4 (only iteration 1). The procedure was reiterated until the prediction 
converged. 

10 

Virus strain 1 : CASE '<» and P < V - 0.798 o 
V- 0.798 a = -2.282562017 



Table 1 


8 


ITER 


APV censor 


APV_pFR 


Prediction P 


value 


0 


< 


-2.083062017 




-2.083062017 


1 


< 


-2.083062017 


-2.362076895 




2 


< 


-2.083062017 


-2.537358188 




3 


< 


-2.083062017 


-2.550836421 





15 Virus strain 2: CASE '<' and P < V - 0.798 <s 
V - 0.798 a = -2.108607374 



Table 19 



ITER 


APV censor 


APV pFR 


Prediction P 


value 


0 


< 


-1.909107374 




-1.909107374 


1 


< 


-1.909107374 


-2.608207782 




2 


< 


-1.909107374 


-2.743936505 




3 


< 


-1.909107374 


-2.748739259 





Virus strain 3: CASE *<' and V <= P 
20 V- 0.798o = -2.156216334 



Table 20 



ITER 


APV censor 


APV pFR 


Prediction P 


value 


0 


< 


-1.956716334 




-1.956716334 


1 


< 


-1.956716334 


-1.343253355 


-2.016673816 


2 


< 


-1.956716334 


-1.401494738 


-2.021216328 


3 


< 


-1.956716334 


-1.405764249 


-2.02157333 
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Virus strain 4: CASE *>' and V < P <= V + 0.798 o 
V + 0.798 a = 0.714928642 
Table 21 



ITER 


APV censor 


APVjpFR 


Prediction P 


value 


0 


> 


0.515428642 




0.515428642 


1 


> 


0.515428642 


0.671585565 


0.714928642 


2 


> 


0.515428642 


0.759236384 




3 


> 


0.515428642 


0.770724812 





5 Example 4: Mutations trajectories 

A methodology for removing unwanted correlations involved an algorithm developed 
by the inventors in which the change in pFR was tracked as the effects of individual 
mutations or combinations of mutations were removed from the dataset The effect of 
each mutation or combination of mutations was separated out. The methodology 
10 followed mutation trajectories towards the global average as the effects of individual 
mutations or combinations of mutations were removed. 

In a first step, the average pFR was calculated for all mutations with a sufficient count 
in the database to be significant, i.e. >20. In the Table below the first and last 10 
mutations of a list of 368 mutations is shown with the corresponding calculated average 
15 pFR. 

Table 22 



Label 


Count 


Average pFR 


54M 


239 


-1.35421631044816 


50V 


129 


-1.28868671545329 


47V 


281 


-1.27082426054035 


84A 


21 


-1.23536347179756 


76V 


187 


-1.20328089469875 


89V 


269 


-1.19273200093637 


91S 


36 


-1.15103609689224 


33M 


22 


-1.12268052165089 


84C 


21 


-1.11529918764429 


54L 


327 


-1.09959239280592 




18L 


65 


0.12143300387582 
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69K 


1387 


0.121561573218861 


89M 


1261 


0.134344491996282 


33V 


406 


0.140725379487564 


17E 


86 


0.154734960149477 


631 


20 


0.159585638802379 


62M 


22 


0.184594303565984 


19S 


21 


0.202798973752203 


15L 


51 


0.213932584381636 


88S 


204 


0.494820688128991 



The extremes were determined, and the mutation with the pFR furthest away from the 
global average was selected. In Table 22, the mutation selected was 54M. 

Following, all virus strains that had the selected mutation were removed, in total it 
5 amounted to 283 virus strains: from 26738 to 26455. A new 

Table 23 of average pER was generated for the remaining mutations. The list below 
shows the first and last 10 mutations of the obtained results. 

Table 23 

10 New table of average per mutation: 



Label 


Count 


Average pFR 


50V 


129 


-1.28868671545329 


84A 


21 


-1.23536347179756 


76V 


168 


-1.13676536523909 


47V 


215 


-1.12849822159876 


91S 


35 


-1.12648669210251 


33M 


22 


-1.12268052165089 


84C 


21 


-1.11529918764429 


54L 


327 


-1.09959239280592 


89V 


213 


-1.05990043312845 


33F 


852 


-0.988257531387902 




18L 


65 


0.12143300387582 


69K 


1384 


0.125380073379929 


89M 


1256 


0.141136938991525 


33V 


404 


0.147380396015872 
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17E 


86 


0.154734960149477 


631 


20 


0.159585638802379 


62M 


22 


0.184594303565984 


19S 


21 


0.202798973752203 


15L 


51 


0.213932584381636 


88S 


202 


0.494762597743788 



The previous steps were reiterated. In Table 24 there is listed the mutations which 
were selected at different iteration counts. 

Table 24 



Count 


Mutation selected 


26738 


54M 


26455 


50V 


26296 


84A 


26272 


91S 


26220 


47V 


25947 


76V 


25762 


54L 


25365 


22V 


25260 


33F 


24545 


321 


24183 


84V 


21784 


54S 


21728 


82F 


21577 


54T 


21427 


24F 


21397 


241 


20894 


73T 


20702 


73 C 


20604 


55R 


20324 


95F 


20194 


10R 


20122 


54A 


20062 


82C 


20039 


88S 


19818 


46L 
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Count 


Mutation selected 


19247 


231 


19190 


58E 


18909 


67F 


18877 


73S 


18105 


53L 


17920 


10F 


17568 


82A 


16637 


461 


16215 


54V 


16028 


35G 


15996 


90M 



The procedure was stopped when the last selected mutation had an average pFR that 
approximated to the global average. In Figure 17, a histogram of the population left 
after removing all virus strains during the iterations is shown. In Figure 18, the 
5 trajectory of mutation 1 8H, which has no significant phenotype, demonstrates the 

underlying cause that a virus strain is resistant due to other mutations than 1 8H (54M, 
76V, 33F, 84V). 

Example 5: Highly correlated mutations 

10 A methodology for removing unwanted correlations proceeded as follows. In a first 
stage, the correlation coefficient between all mutations (with a sufficient count in the 
database, i.e. >20) and the pFR was calculated. In Table 25 below there is listed the 
first and last 10 coefficients of a list of 202 coefficients that were calculated. 



Table 25 



NAME 


correlation with APV pFR 


P084 V 


-0.51430323209603 


P090_M 


-0.510166810424169 


P010 I 


-0.43843660921923 


P046 I 


-0.430221405121849 


P071 V 


-0.400337497273138 


P033 F 


-0.385947043862637 


P082 A 


-0.343946685713202 


P054 V 


-0.339269018202483 


P032 I 


-0.275105400287351 
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NAME 


correlation with APV pFR 


P010 F 


-0.263412991920486 




P065 D 


0.044821230615045 


P012 A 


0.0476139542192145 


P014 R 


0.0485859961407927 


P033 V 


0.0571605219086003 


P041_K 


0.0713497764580897 


P063 S 


0.071416853283617 


P030 N 


0.080199177466301 


P089 M 


0.0904859904655573 


P069 K 


0.0926109439533826 


P088 S 


0.101920449277774 



5 Consequently, the extremes were determined (maximum, minimum), and the mutation 

with the highest (absolute value of) correlation coefficient was selected In this case 
was P084_V. 

In the following step, a linear model for the pFR with the selected mutation(s) (from 
step 2, all previous iterations) was calculated. The predicted model obtained was 
10 Predicted pFR = -0.844 * M 84 

Following, the residue was taken (pFR minus the predicted value from the model). In 
Figure 19 a graph of the residues as a function of the measured values is shown. In 
Figure 20, the same graph is represented in the form of histograms where the 
distribution of the residue may be observed. 

15 Then, the correlation coefficient between all mutations with a sufficient count in the 

database and the residue was calculated. Results of the first and last 10 variable are 
shown here below. It will be observed that the order of the mutations had changed 
because the influence of mutations P084 V had been removed. 



Table 26 



NAME 


Correlation with Residue 


P082 A 


-0.402088216120049 


P090 M 


-0.373018037350597 


P033 F 


-0.347337204147266 


P032 I 


-0.325689507827784 
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P046 I 


-0.324078296352946 


P010 I 


-0.321343698855709 


P054_V 


-0.311246000758214 


P071 V 


-0.290388889036061 


P047 V 


-0.272571613897309 


P046 L 


-0.234148912637279 




P012 S 


0.0358242687063381 


P014 R 


0.0401577992704191 


P012 A 


0.0442436406740132 


P063 S 


0.0484345347109348 


P033 V 


0.0537012592855092 


P030 N 


0.0548222080117112 


P041 K 


0.0659977808671604 


P089 M 


0.078693680117922 


P069 K 


0.0835173137603877 


P088 S 


0.110781153455097 



5 Consequently, the extremes were determined again, and the mutation with the highest 

absolute value of the correlation coefficient was selected The mutation selected now 
was P082_A. 

A new linear model for the pFR with the selected mutation P082_A, was calculated. 

pFR - -0.782*M84 + -0.435*M82 

10 After 6 iterations, the following resistance coefficients for a selected group of 
mutations was obtained. 

Table 27 



Parameter 


3 


P084 V 


-0.512345233450494 


P082_A 


-0.247464800298171 


P090 M 


-0.156011849225004 


P033_F 


-0.532092050020052 


P046 I 


-0.205719880528639 


P047_V 


-0.656374746817602 
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In Figure 21, a graph is represented in the form of histograms showing the residues 
after the 6 parameters were taken into account. 

The reiterative procedure continued until the last selected mutation had a correlation 
coefficient that approximated to zero. 

5 

Example 6: Results from linear regression modeling 

In an initial test, genotypes and corresponding phenotypes determined for ritonavir 
(RTV) for 28,540 HIV-1 clinical isolates were used. The linear regression analysis 
identified 20/22 RTV resistance-associated mutations described in the IAS mutation list 
10 (all except 10F and 771) (see Figure 13). Additional mutations whose effect on RTV 
susceptibility had been previously described (e.g. 73S/T/C, 84A/C and 88D) were also 
identified (Figure 14). Overall, 53 single mutations and 96 pairs of mutations were 
identified as having significant effect on susceptibility to RTV. 

The predicted phenotype was compared to the measured phenotype in a leave-one-out 
1 5 cross-validation, demonstrating a root mean square error of 0.3 1 (logFR) (see Figure 

15. The error rate of the linear modeling method [5.62% (sensitivity==93.0%, specificity 
— 95.4%)], compared favourably to a decision tree-based model [Beerenwinkel, PNAS 
99, (2002) 8271-8276] [10.2% (sensitivity=89.8%, specificity-89.7%)] (see Figure 16). 

The robustness of the algorithm as a function of the size of the input dataset was 
20 assessed using smaller subsets of data. Nine of 22 IAS resistance-associated mutations 
for RTV could be identified with subsets > 5% (1600 isolates) of the original data. 
However, the accuracy of the predicted contribution of the mutations improved with 
increasing dataset sizes up to 50% of the original database (median standard error of 
the predicted contributions decreased 50%). Some secondary mutations (e.g. 10R, 321, 
25 82S) were identified as having a significant contribution to resistance only when the 
subset size reached a similar 50% level. 

Example 7: Comparison of genotype-to-phenotype prediction for different 
Artificial Intelligence techniques 

30 Analyses were performed on matching genotype/phenotype datasets for all 1 6 HIV 

inhibitors currently available. The matching genotype/phenotype datasets consisted of 
approximately 30,000 data points for most drugs except Lopinavir and Tenofovir. 

As an example, the following results for Ritonavir were obtained: 

• A log(FR) root mean squared error of 0. 3 1 (MSE=0.096). 
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• A classification error of 5.6% (with regard to a standard cutoff applied by the 
inventors of Fi?=3.5). 

(sensitivity=93.0% ? specificity=95.4%). 

• Regression model identified 53 single mutations and 96 pairs of mutations. 20 out 
5 of 22 mutations of the IAS list are confirmed in this model. 



Table 28 







CV-MSE * 
(inlogQFR)) 


Classification 
error 


Nr of samples 


Coverage 


Model 
inspection 
possible 


Neural network 
(Lopinavirf^ 


0.88 


n/a 


n/a 


1,322 


100% 


N 


Support Vector 
Machine 
(Ritonavir) 4 


0.79 


0.176 


n/a 


652 


100% 


N 


Support Vector 
Machines (Tibotec 
data, Ritonavir) 


0.81 


0.144 


n/a 


17,453 


100% 


N 


Decision tree 
(Ritonavir) 3 




Classification 
only 


10.2% 


469 


100% 


Y 


Clustering 
{Indinavir) 5 


n/a 


n/a 


15.3% 


1,152 


100% 


N 


Self Organizing 
Map (Saquinavir) 2 




Classification 
only 


15% 


811 

(38 matching) 


84% 


N 


Linear regression 
modeling (Virco 
data, Ritonavir) 


0.88 


0.096 


5.6% 


34,502 


100% 


Y 



(*) CV-MSE: cross-validation mean squared error. Depending on the analysis, it is a 

leave-one-out or a 10-fold cross-validation 
[1] A 28-Mutation Neural Network Model that Accurately Predicts Phenotypic 

Resistance to Lopinavir (LPV) 
D Wang, R Harrigan and BA Larder, Antiviral Therapy 2001 (Supplement 1): 105 
[2] Predicting HIV Drug Resistance With Neural Networks 

S Draghici, R Potter, Bioinformatics, Vol. 19 no. 1, 2003 (p. 98-107). 
[3] Geno2pheno: Interpreting Genotypic HIV Drug Resistance Tests 

N Beerenwinkel et al., Intelligent Systems in Biology, Nov/Dec 2001. 
[4] Geno2pheno: estimating phenotypic drug resistance from HIV- J genotypes 

N Beerenwinkel et al., Nucleic Acids Research, 2003, Vol. 3 1, No 13. 
[5] Predicting phenotype from genotype; a comparison of statistical methods 

A Foulkes et al. 
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Neural networks, support vector machine and clustering techniques axe no suitable 
candidates for a quantitative prediction system with the requirement that such a system 
should have a descriptive power in order to be inspectable by experts and to be able to 
motivate certain predictions to customers. Decision trees allow experts to have insight 
5 in how the decision process works. But decision trees require massive amounts of data 

to build complex trees, since the information in the data is not optimally used. 

Based on the performed analyses and the linear regression modelling feasibility study, 
linear regression modelling seems to meet the requirements for a quantitative prediction 
system. Linear regression seems to outperform other examined techniques and offers 
10 the possibility of inspection to HTV-experts. Considering the lower error rates, the 
linear regression modelling allows the optimisation of drug therapy in patients. 

Example 8: Comparison of the regression linear model with a rules-based 
algorithm 

15 The regression linear model developed by the inventors was used to test the drug- 

associated resistance of one HTV-1 sample on nevirapine, delavirdine, and efavirenz. 
In parallel, the same sample was run in a rules-based algorithm methodology as 
described in WO01/79540. 

The results were expressed in FR, or fold change in IC50 or EC50, relative to reference 
20 wild-type virus, which is the drug concentration at which 50% of the enzyme activity is 

inhibited, and is expressed in \iM units. The FR cutoffs values for normal susceptible 
ranges were 8, 10, and 6, for nevirapine, delavirdine, and efavirenz, respectively. 

The phenotypic antiviral experiment was taken as the gold-standard by the inventors. 
Said phenotypic antiviral experiment was performed as described in WO97/27480. 
25 Results of the three methodologies are enclosed in Table 3 below. 

According to the results obtained by the rules-based algorithm, the patient's sample 
would be susceptible to all three drugs. However, when the results obtained by the 
linear regression model were considered, the sample showed resistance against 
nevirapine and efavirenz and susceptibility against delavirdine. These last results were 
30 confirmed by the phenotypic antiviral experiments. 



Table 29 





Rules-based algorithm 


Linear regression 
model 


Phenotypic antiviral 
experiment 




Matches in 
database 


FR 


FR 


FR 
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Neviiapine 


321 


3.6 


176.1 


>89 


delavirdine 


301 


1.9 


3.5 


3.7 


efaviienz 


300 


1.9 


12.9 


17.5 



WO 2004/111907 



PCT/EP2004/051084 



-47- 



CLAIMS 

1 , A method for quantitating the individual contribution of a mutation or combination 
of mutations to the drug resistance phenotype exhibited by HIV, said method 
comprising the step of performing a linear regression analysis using data from a 
5 dataset of matching genotypes and phenotypes, 

wherein the log fold resistance, pFR, of each HIV strain is modelled as the sum of 
all the individual resistance contributions for each of the mutations or combinations 
of mutations that occur in HIV according to the following equation; 

pFR = P A + $ B M B + $M n P Z M Z + e 

1 0 wherein each individual resistance contribution is calculated by multiplying a 

mutation factor. Ma > Mb , Mz, for each mutation or combination of mutations 
by a resistance coefficient $A> f$B> — * &Z> 

wherein for a combination of mutations, the mutation factor M n represents the co- 
occurrence of one mutation with other one or more mutations and the coefficient fin 
15 represents the synergy or antagonism between the one mutation with the other one 

or more mutations; 

wherein the mutation factor assigned to each mutation or combination of mutations 
reflects the degree to which that mutation or combination of mutations is present in 
the HIV strain and, if present, to which degree the mutation is present in a mixture; 

20 wherein each resistance coefficient reflects the contribution of the mutation or 

combination of mutations to the fold resistance exhibited by the strain; 

and wherein the error term £, represents the difference between the modelled 
prediction and the experimentally determined measurement. 



25 2. A method according to claim 1, wherein correlations are removed from the dataset 
for correlated mutations where not all correlated mutations contribute to the drug 
resistance phenotype, using an algorithm to track the change in pFR for each 
mutation as the effects of individual mutations or combinations of mutations are 
removed from the dataset. 

30 

3. A method according to claim 2, wherein the algorithm performs the following 
steps: 

a) calculate average pFR for all mutations with a sufficient count in the 
database to be significant; 
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b) detenriine the extremes (maximum;, minimum), and select the mutation with 
the pFR furthest away from the global average; 

c) remove all virus strains that have the selected mutation from the dataset and 
reiterate from step a); 

d) stop when the selected mutation in step b) has an average pFR that 
approximates to the global average; 

such that removing virus strains with a certain resistance causing mutation 
results in an increase of the average pFR for correlating mutations, which thus 
have a higher average pFR. 

4. A method according to any one of claims 1 -3, wherein the algorithm performs the 
following steps: 

a) calculate correlation coefficient between all mutations with a sufficient 
count in the database and the pFR; 

15 b) determine the extremes (maximum, minimum), and select the mutation with 

the highest absolute value of correlation coefficient; 

c) calculate a linear model for the pFR with the selected mutation(s) (from step 
b), all previous iterations); 

d) take the residue; 

20 e) calculate correlation coefficient between all mutations with a sufficient 

count in the database and the residue; 

f) determine the extremes (maximum, minimum), and select the mutation with 
the highest absolute value of correlation coefficient; 

g) calculate a linear model for the pFR with the selected mutation(s) (from step 
25 f), all previous iterations); and 

h) reiterate from step d); 

i) stop when the selected mutation in step g) has a correlation coefficient that 
approximates to zero. 



30 



5. 



A method according to any one of the preceding claims, wherein censored values in 
the genotype / phenotype database are replaced by a maximum likelihood 
estimation. 
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6. A method according to claim 5 ? wherein for each iteration of the linear regression, 
the following steps are performed until the predictions converge: 

a) Calculate a linear regression model without censored values; 

b) Use the phenotypic measured value Vo as if the censor was " = " 3 e.g. when a 
5 result is expressed as -log FR < 4, we will treat Vo as -log FR =^4; 

c) Look at the prediction P from the model and apply either: 
When case -censor: 

■ P < Vo — 0.798 a (center of gravity of half Gaussian distribution) 

o Remove value from training data for next iteration 
10 ■ V 0 -O/798a<P<Vo 

o Use V = V 0 - 0.798 o for next iteration 

■ V 0 <P 

o Use V centre of gravity of tail (<V) of a normal distribution N (P, 
c) as value for next iteration. 

15 When case c >'-censor: 

■ P > Vo + 0.798 o (center of gravity of half Gaussian distribution) 

o Remove value from training data for next iteration 

■ V 0 + O.798a>P>V 0 

o Use V = V 0 - 0.798 a for next iteration 

20 ■ V 0 >P 

o Use V centre of gravity of tail (>V) of a normal distribution N (P, 
a) as value for next iteration. 

d) Calculate a linear regression model and for the censored values in the linear 
regression model, either remove the data-point from the training set, or use V 

25 instead of the censored phenotypes measurement, as described in step c); 

e) Re-iterate from step b) until prediction converges. 



30 



7. 



A method of identifying a mutation that effects the degree of drug resistance 
exhibited by an HIV strain using a method according to any one of the preceding 
claims. 
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8. A method according to claim 1 wherein the contribution of a mutation pattern to the 
drug resistance phenotype exhibited by an HIV strain is calculated, said method 
comprising the steps of: 

a) obtaining a genetic sequence of said HIV strain, 

5 b) identifying the pattern of mutations in said genetic sequence, wherein said 

mutations are associated with resistance or susceptibility to drug therapy, and 

c) calculating the fold resistance of the HIV strain as compared to the wild type 
HIV strain by performing a linear regression analysis according to claim 1 . 



10 9. A method according to claim 8, which incorporates a method according to any one 

of claims 1-7. 



10. A method according to any one of the preceding claims, wherein in the case of 
small datasets for particular mutations or combinations of mutations, the method is 
15 applied recursively to the set of virus strains that exhibit those particular mutations 

or combinations of mutations. 



1 1 . A diagnostic method for optimising a drug therapy in a patient, comprising 
performing a method according to any one claims 7-9 for each drug or combination 

20 of drugs being considered to obtaining a series of drug resistance phenotypes and 

therefore assess the effect of the plurality of drugs or drug combinations on the 
predicted fold resistance exhibited by the HIV strain with which the patient is 
infected and selecting the drug or drug combination for which the HIV strain is 
predicted to have the lowest fold resistance. 

25 

12. A method according to any one of claims 7-9 and 11, wherein the resistance 
coefficient for each mutation is calculated using a method according to any one of 
claims 1-6. 



30 13. Use of a method according to any one of claims 1-6 for assessing the efficiency of a 

patient's therapy or for evaluating or optimizing a therapy. 



14. A diagnostic system for quantitating the individual contribution of a mutation or 
combination of mutations to the drug resistance phenotype exhibited by an HIV 
35 strain, said system comprising: 

a) means for obtaining a genetic sequence of said HIV strain; 
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b) means for identifying the mutation pattern in said genetic sequence as compared 
to wild type fflV; 

c) means for predicting the fold resistance exhibited by the HIV strain using any 
one of the methods of claims 1-12. 

5 

15. A computer apparatus or computer-based system adapted to perform the method of 
any one of the claims 1-12. 



16. A computer program product for use in conjunction with a computer, said computer 
10 program comprising a computer readable storage medium and a computer program 

mechanism embedded therein, the computer program mechanism comprising a 
module that is configured so that upon receiving a request to quantify the individual 
contribution of a mutation or combination of mutations to the drug resistance 
phenotype exhibited by HIV, or to calculate the quantitative contribution of a 
15 mutation pattern to the drug resistance phenotype exhibited by an HIV strain, it 

performs a method according to any one of claims 1-12. 
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